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ABSTRACT 

The f requen cy of evaluation across organizational 
levels (i.e., evaluation of inferiors by superiors) is related to 
three variables: the existence of bureaucratic rules, availability of 
information across levels, and interaction among participants. In a 
processual perspective, as opposed to a structural one, evaluation is 
viewed as a key mechanism for linking levels in organizations. The 
interlevel linkages created by evaluation processes among 
superintendents, principals, teachers, and students are examined. The 
fewer the levels in an evaluation situation in schools, the stronger 
the correlations between frequency of evaluation and bureaucratic 
procedures, availability of information, and interaction. 
Availability of information and interaction were more positively 
correlated with frequency of evaluation than were bureaucratic rules, 
which may serve as substitutes for direct evaluation. Interaction was 
the most powerful predictor of the frequency of the principal's 
self-reported evaluation of teachers on the task of teaching reading; 
bureaucratic rules were least powerful. Both information and 
interaction were powerful predictors of the teacher's report of the 
frequency with which the principal evaluated the teacher on the task 
of teaching subject matte r; bureaucra tic rules ha d no separate, 
effect. Findings suggest that it is theoretically and empirically 
fruitful to adopt a processual approach in the study of interlevel 
linkages in school organizations. Frequency of evaluation appears to 
be a major indicator of the extent of loose coupling within 
organizations, ( Author/EVH) 
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Introductory Statement: 



The mission of the Stanford Center for Research and Development 
in Teaching is to improve teaching in American schools. Current major 
operations include three research and development programs--Teaching 
Effectiveness, The Environment for Teachings and Teaching and Linguistic 
Pluralism--and two programs combining research and technical assistance, 
the Stanford Urban/Rural Leadership Training Institute and the Hoover/ 
Stanford Teacher Corps Project. A program of exploratory and related 
studies provides for smaller studies that are not part of the major 
programs . 

This paper is part of the work of the Environment for Teaching 
Program. 
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Abstract 



This paper relates the frequency of evaluation across organiza- 
tional levels (i.e., evaluation of inferiors by superiors) to three 
variables: the existence of bureaucratic rules, the availability of 
information across levels, and interaction among participants. We 
have taken a processual perspective, as opposed to a structural one, 
viewing evaluation as a key mechanism for linking levels in organiza- 
tions. Using data from 103 schools in 30 northern California school 
districts, we examine the interlevel linkages created by evaluation 
processes among superintendents, principals, teachers, and students. 

The fewer tl ? levels '.n an evaluation situation in schools, the 
stronger the correlations "etween frequency of evaluation and bureau- 
cratic procedures, availabijiity of information, :*.id interaction. 
Availability of information and interaction were more positively 
correlated with frequency of evaluation than were bureaucratic rules, 
which may serve as substitutes for direct evaluation. 

Through regression analyses we found that interaction was the 
most powerful predictor of the frequency of the principalis self- 
reported evaluation of teachers or- the task of teaching reading; 
bureaucratic vules were least powerful. Both information and inter- 
action were powerful predictors of the teacher^s report of the 
frequency with which the principal evaluated the teacher on the task 
of teaching subject r;.atter; bureaucratic rules had no separate effect 

These fir.dings suggest that it is thecrc'ically as well as 
empi-icaliy fruitful to adopt a processual approach in the study of 
int?rlev.:l linkages in school organizations. Frequency of evaluation 
appears to be a najor indicator of the extent of loose coupling withi 
organizations . 
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FREQUENCY OF EVALUATION AS A MEASURE OF LINKS 
BETWEEN LEVELS IN SCHOOL ORGANIZATIONS 



Emmanuel A. Utande and San^'cru M. Dornbusch 
Introduct i on 

This paper attempts to identify the pattern of relationships be- 
tween frequency of evaluation across levels in the organizational 
hierarchy and three other variables: the existence of bureaucratic 
rules, availability of information across levels, and interaction 
among participants. 

We have taken a processual or functional perspective, as opposed 
to a structural perspective, viewing evaluation as a key mechanism for 
linking or coupling levels within organizations. Specifically, we 
will study school organizations, examining the usefulness of "fre- 
quency of evaluation" as a device for discovering the strength of 
linkages up and down the school system. To date there has been no 
systematic study of evaluation processes as an indicator of the degree 
to which levCiS of an organization are linked. Schools are usually 
considered loosely coupled, with a relatively low level of coordination 
of performances throughout the organization (Glassman, 1973; Cohen 
and March, 1974; March and Olsen, 1975; Weick, 1976; Meyer and Rowan, 
1975). 

Evaluation is central to all forms of organizatior . Evalaution 
includes allocating tasks to performers, setting standards for judging 
performances; and sampling and appraising performance output. These 
evaluation processes are a key element in organizational control 
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velopment Associate of the Stanford Center for Research and Develop- 
ment in Teaching. 



(Dornbusch and Scott '''.S:. In the context of this study, to evaluate 
is also to control , 

We will examin the interlevel linkages of evaluation processes 
among superintendents, principals, teachers, and students. Our data 
come from 103 schools in 30 school districts. While we recognize that 
linkages may assume different forms from one unit to another, our 
primary interes-: is vertical linkages. Thus, we are oncerned with 
the relationship between three variables (bureaucratic rules, informa- 
tion, and interaction) and the frequency with which evaluators, usually 
superiors in the organizational hierarchy, perform their control tasks. 

It is useful to identify some of the factors associated with the 
frequency of evaluation of principals by the superintendent, of 
teachers by the principal, and of students by the teachers. We know 
that, with the exception of teachers evaluating students, luerarchical 
evaluation in schools is generally infrequent (Thompson, Dornbusch, 
and Scott, 1975). Nevertheless, some evaluation does occur, and 
knowledge of factois associated with it will both improve our under- 
i':tanding of organizations and also have policy implicitions. We 
believe that "Evaluation is fundamental to the regulation of task 
performances in organization systems; and evaluation processes are 
essential to the regulation of the control systems themselves, as 
arbitrary power is domesticated to become regularized authority** 
;;Dornbusch and Scott, 1975, p. x). 

Until recently, the literature in this area included discussions 
of different control strategies employed by organizations. Among 
commonly discussed strategies were direct supervision; performance 
records (Blau and Scott, 1962; Anderson, 1968); impersonal meclianisms, 
such as the conveyor belt (Walker and Guest, 1952); socialization or 
professionalizat ion; and the use of bureaucratic rules (Gouldner, 
1954; Goslin, 1965) . 

We ^ill focus on one major control strategy, the use of bureau- 
cratic rules in school, and relate that strategy to evaluation. 
Gouldner has shown the importance of rules and their enforcement in 



industry (Gouldncr, 19S4). Our analysis of rules will link them to 
the evaluation system as part of our analysis of control systems 
which couple levels in school systems 

A new approach to hierarchical systems of control is concerned 
with the extent of linking or coupling within an organization. No 
formal definition of coupling seems widely accepted, but we can 'name 
some characteristics of social systems zhiit rougnly describe loose 
coupling. For example, Weick (1976) portrays loose coupling between 
parts of an organization as indicating the parts are attached, but 
their attachn-ent may be circumscribed, infrequent, and weak. Though 
Weick 's attempt tr identify characteristics associated with loose 
Cvoupling is commendable, he neglects to mention fundamental processes 
that cperatLJ across organizational levels--such as patterns of 
evaluation. Physical separation of organizational participants is 
neither necessary nor sufficient to characterize loosely coupled 
systems. Organizational systems nre linked through different pro- 
cesses of which evaluation is one. Tlierefore, we suggest a perspective 
that would examine evaluation processes across organizational levels. 
Thus, '^valuation processes could be an indicator of coupling. 

Our study of interlevel linkages of performance evaluation in- 
corporates the following assumptions. First, the need^ for an explicit 
pattern of allocating tasks to participants (a part of the evaluation 
process) often leads to the establishment of specific rules or pro- 
cedures. Second, evaluators want their evaluations to be perceived 
as based on relevant information. The availability of information 
also implies the possibility of regular inspection of task performances. 
Third, when evaluators and evaluatees interact, their contact often 
provides an increased possibility that information across levels will 
be available or appraisals will be made. Tlius, frequency of evalua- 
tion will be associated with the presence of rules, availability of 
information, and frequency of interaction. 

Although we do not make any assumption about the direction of 
causation, we will examine the association between the above three 
variables and the fret^ucncy of evaluation. It is possible that 
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frequency of evaluation, for example, is the independent variable 
that leads to increai^ed availability of information or increased 
contact. Similarly, although less directly, bureaucratic rules or 
procedures may be introduced as a substitute for frequency of 
evaluation, thus producing a lower relationship between frequency of 
evaluation and the presence of such rules or procedures. We cannot 
determine causation for these associated variables; we can test, 
however, the strength of the relationships between frequency of 
evaluation and each of the three variables. Our general propositions 
arc as follows: 

There will be more frequent evaluation of performances if 
there are explicit rules, regulations, or policies about 
a given task. 

There will be more frequent evaluation of performances if 
more information about u task is readily available to an 
eva luator . 

There will be more frecjuent evaluation of performances if 
there is more frequent interaction between an evaluator and 
an evaluatee. 

ihe number of levels involved in evaluation may affect the 
strength or direction of [)retlicred relationships. W^cn we test these 
three general propositions, we consider the number of levels to be the 
distance between the highest level involved in an evaluative act and 
the lowest. Thus, if the superintendent (district level) evaluates 
principals (school level) on the basis of student performance or 
ach i eveinent , we wi 1 1 t reat t hi s eval uat i on s i tuat ion as i nvol v ing four 
levels, fr(;m superintendent through [)rinci])als and teachers to student 
pcrfr>rmance. if the evaluation of [)rincipals by superintendent is 
basea on the performance of teachers, we will treat this as three 
levels. if the superintendent's evaluation of principals looks at 
the princL])als* [Performance only, that evaluation situation involves 
only two levels. (l-or collegial eva lu.at i on , such as among teachers, 
the evaluation o[)erates witr.in a single level. IVc deal only inci- 
dentally with colleiiial eva 1 ;ia t i oa . ) 



1 ■ mpiriccil llv^')0tlicses 



From the three pro[io5itions, we derived forty-lwo empirical 
hypotheses relating frequency of evaluation in iichool organizations to 
the existence of bureaucratic rules, availability of information, and 
interaction among participants. Although some hyj^otheses may seem 
repetitive, each hypothesis deals with frequency of evaluation In a 
specific task situation, 

I . Bur eaucrat i zat ion Hypo theses 

Superintendent as tlie t:v^i^ uatc)r 

(1.1) The more explicit the d i St r id -wi de policies con- 
cerning the type of curricular materials that teachers are ex- 
pected to use, the more likely a superintendent is to report 
frequent evaluation of principals on the task of school adminis- 
tration (5 leve Is) . 

(1.2) The more explicit the district-wide policies concerning, 
instructional methods toacliers are expected to use, tlie more 
likely a superintendent is to report frequent evaluation of 
principals on the task of school administration (3 levels). 

(1.."^) The more explicit the district-wide policies con- 
cerning rules for student conduct, the more likely a superintendent 
is to report frequent evaluation of principals on the task of 
school admlnistrat ion (4 levels ) . 

(\.4) The more explicit the district-wide policies con- 
cerning the criteria for evaluatinv^ student learning, the more 
likely a superintendent is to report frecpient evaluation of 
f)rincii>als on the task of school administration (4 levels). 

^^'^ * "^lil'*^ ^ '^iL ^Jlil i -Va hia^t p r 

(l.T)) If a sciiool lias procedures i'or evaluating tlie siicc''. 
of a i*eading program I'or studcMUs, a principal is likely to rcjcr* 



more frequent evaluation of teachers on the teaching of reading 
(5 levels). 

(1.6) If the district office expects a ]>rincipal to keep 
records containing systematic information on teacher evaluation, v 
the principal will report more frequent evaluation of teachers on 
the teaching of reading (5 levels). 

(1.7) If there arc standard district-wide forms for teacher 
evaluation, a principal is likely to report more frequent evalua- 
tion of teachers on the teaching of reading (3 levels). 

(1.8) If a school has evaluation forms for teacher evalua- 
tion, a principal will report more frequent evaluation of teachers 
on the teaching of reading (2 levels). 

Teache r as the livaluator 

(1.9) If there are rules or guidelines governing classroom 
procedures, a teacher is likely to report more frequent evalua- 
tion of students* written work in math, reading, and social 
studies (2 levc Is) . 

(I. 10) If a teacher usually adheres to a definite secjuencc 
of concepts or lessons in instructional programs, he or she is 
likely to report more frequent evaluation of students' written 
work in math, reading, and social studies (2 levels). 

T eacher as the livaluatee 

(1.11) If there are school-wide policies that govern stu- 
dent ronduct , a teacher is likely to report receiving more 
fretiuent evaluatit)n by the principal on the task of maintaining 
control of students \'S levels). 

f 1 . 1 2 J 1ft here a re schou 1 -w i de po 1 i c i es that govern 
s tutlent <:ontluc t , a teacher is likely to repor t rece i v i ng more 
frecjuent evaluation by other teachers on the task of maintaining 
control of students ( ,S levels). 



II. Information Hypotheses 



Superintendent . iS the Evaluator 

(2.1) If a superintendent has readily available information 
for each school on criteria-based achievement scores for students, 
he or she is likely to report more fre^. '^nt evaluation of prin- 
cipals on the task of school admiui stration (4 levels). 

(2.2) If a superintendent has readily available information 
for each school on methods of reading instruction used by teachers 
\\e or she is likely to report more frequent evaluation of principa 
on the task of school administration (3 levels), 

(2.3) If a superintendent has readily available information 
for each school on the criteria for evaluating student learning, 
he or she is likely to report more frequent evaluation of 
principals on the task of school administration (4 levels). 

(2.4) If a superintendent considers himself or herself 
informed about instructional matters, he or she will report more 
frequent evaluation of principals on the task of school admini- 
stration (3 1 evel s ) , 

(2.5) If a superintendent uses student scores on either 
state-mandated standardized tests or other ability tests in 
evaluating schools, he or she is likely to report more frec^uent 
evaluation of principals on the task of school administration 
(4 levels). 

Principal as the [-valuator 

(2.6) If a principal has readily available information on 
methods of reading instruction used in each classroom, he or she 
is likely to report more frequent evaluation of teachers on the 
teaching of reading (2 levels). 

(2.7) if a principal has readily available information on 
either criteria-based achievement scores or on the criteria for 
evaluating student Ic^arning, he or she is likely to report more 
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frequent evaluation of teachers or the teaching of reading 
(5 levels). 

(2.8) If any other systematic data on student performances 
are used as sources of information for evaluating a reading pro- 
gram, the principal is likely to report more frequent evaluation 
of teachers on the teaching of reading (3 levels). 

Teacher as the E va 1 ua t ee 

(2.9) If a teacher perceives the principal as well-informed 
about instructional matters in general, he or she is likely to 
report more frequent evaluation by the principal on the task of 
teaching subject matter (2 levels). 

(2.10) If a teacher perceives the principal as well-informed 
about discipline problems, he or she is likely to report more 
frequent evaluation by the principal on the task of maintaining 
control (2 levels). 

(2.11) If a teacher perceives the principal as well-informed 
about classroom instructional activities, he or she Is likely to 
report more frequent evaluation by the principal on the task of 
teaching subject matter (2 levels). 

in. Interaction Hypotheses 

In this study, no interaction hy])Othesis extends boyond two 
level 5 . 

Superintendent as the Cv aluator 

(3.1) The more a superintendent talks with principals about 
their work, the more frequently he or she will report evaluation 
of princL[)als on school administration (2 levels). 

(3.2) If a su[)crintondent reports giving advice or informa- 
tion about management to [)rinci]vil s, he or she will report more 
frecjuent evaluation of ]irincipals on the task of school administra- 
tion (2 level s ) . 

'i 
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Principal as the l ivaluator 

(3.3) If a principal talks with teachers about their work, 
he or she will report more frequent evaluation of teachers on the 
teaching of reading (2 levels). 

(3.4) If a principal reports giving advice about teaching 
to teachers, he or she will report more frequent evaluation of 
teachers on the teaching of reading (2 levels). 

Teacher as the Evaluator 

(5.5) If a teacher talks to students al:>out their specific 
skill needs, he or she will rej^ort more frequent evaluation of 
students* written work in reading (2 levels). 

(3.6) If a teacher talks to students about their interest in 
reading, he or she will report more frequent evaluation of stu^ 
dents* written work in reading (2 levels). 

Teacher as the Evaluatee 

(3.7) If a teacher talks more often with the principal, he 
or she will report more frequent evaluation by the principal on 
the task of teaching subject matter (2 levels). 

(3.8) If a teacher talks more often with the principal, he 
or she will report more frequent evaluation by the princi[uil on 
the task of maintaining control (2 levels). 

(3.9) If a teacher seeks out the principal to talk about 
the teacher^s work, he or she will report more frequent evalua- 
tion by the principal on tlie task of teaching subject matter 

(2 levels). 

(3.10) If a teacher seeks out the principal to talk about 
the teacher*s work, he or she will report more frequent evaluation 
by the principal on the task of maintaining control (2 levels). 

(3.11) If a teacher reports advice on classroom teaching 
practices by the princi[Vil. the teacher will report more fre- 
quent evaluation by the principal nn the task of teaching sul^iec! 
matter (2 levels). 
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CS. 121 If ;i tcacluM reports advice on classroom teaching 
practices by the principal, tlie teaclier will report more frequent 
evaluation t)y ttie pr inc ipal 'on tlie task of maintaining control 
(2 levels) . 

(3.15) If a teaclier takes otlier classroom teaeliers into 
account witli respect to teaching approach, he or she will rnport 
more frequent evaluation by other teachers on the task of teaching 
subject matter (1 level). 

(3.14) If a teacher takes other classroom teachers into 
account with respect to teaching approach, he or she will report 
more frequent evaluation by other teachers on the task of main- 
taining control (1 level). 

(3.15) If a teacher takes other classroom teachers into 
account with respect to lesson content, he or she will report 
more frequent evaluation by other teachers on the task of teaching 
subject matter (1 level). 

(.3.16) If a teacher takes other classroom teachers into 
account with respect to scheduling of class periods, he or she 
will report more frequent evaluation by other teachers on the 
task of maintaining control (1 level). 

(3.17) If a teacher shares instructional materials with 
other teachers, he or she will report more frequent evaluation 
by other teachers on maintaining control (1 level). 

(3.13) If a teacher i3 a. member of a teacliing team, he or 
she is likely to report more frequent evaluation by other 
teachers on teaching subject matter (1 level). 

(3.19 1 If a teacher is a member of a teaching team, he or 
she is likely to report more frequent evaluation by other teachers 
on maintaining control (.1 level). 
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O pera t i onal nei 'init i on o f Key \*a r i ah 1 ei; 
Bureaucrat i zat ion 

Bureaucratization refers to any process made relatively routine 
by explicit rules or policies. Those rules may be established by the 
state, the district office, or an individual school. The existence of 
rules or procedures is a good indicator of bureaucratization in school 
organizations. The rules may be concerned with allocating tasks, 
setting standards, sampling performances, or appraising performances. 
We are interested in the existence of rules and not whether they 
really function properly, because we expect that the mere existence 
of rules or standard operating procedures will exert some pressure 
on e valuators as well as evaluatees. 

Inf ormat ion 

Information is used here to refer to self-reported knowledge of an 
event. An event can relate to a task, a performance, or a perfoinner. 
Knowledge of student achievement scores is an example of information. 
Bureaucratization could be related to information in a variety of ways. 
For instance, a district or school may have an explicit rule or policy 
governing the flow of knowledge about tasks, performances, and performers. 
Information is also related to interaction, as noted below. 

Interaction 

Interaction is a ()roccss that involves some form of social ex- 
change between evaluator and evaluatec, usually face-to-face. Inter- 
action occurs as evaluator and evaluatce engage in behavior that brings 
them together. We are not concerned witli the motivation for such 
contacts. Indicators of interaction vn this context include talkini; 
with other partic i pants in the organi z.it i on and sometimes giving 
advice or information t(' task [lerformers. The relationship betwci-n 
interaction and information evolves from the fact that social exclianv.e 
i nco-^porates some form of communication of knowledge. 
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Evaluat ion 

Hvaluation in the context of this stud>* describes a process 
whereby participants "learn in any way, indirectly or directly, how 
well or poorly their evaluator thinks they are doing on an organiz^a- 
tional task" (Dornbusch and Scott, 1975, p. 135). In school organi- 
zations, superintendents, principals, and teachers may be the 
evaluators. In this study evaluation is operationali zed to be task 
specific. Superintendents were asked how frequently they evaluate 
principals on the single task of school administration. Principals 
were asked how frequently they evaluate teachers on two tasks: teaching 
subject matter and maintaining control in the classroom. Teachers were 
asked how frequently they evaluate students' written work in three sub- 
jects : math, reading, and soc ial studies. 

Because the data we used had been collected for another study 
before we conceptual i -ed this research problem, our choice of indi- 
cators to operational ize each of our key variables was constrained. 
Tor example, we can make no distinction between a policy and a pro- 
cedure that may govern the performance of a specific task. Both policy 
and procedure are treated as indicators of bureaucrat i 7-at ion , although 
they might not be related to frequency of evaluation in the same 
fashion--at the district level of school organization, we have only 
policies as Indicators of bureaucratization, while at the school and 
classroom levels we have only procedures. Neither do we distinguish 
between procedures that govern the performance of "active" tasks and 
those that govern "inert" tasks (Dornbusch and Scott, U>75), although 
rules concerning instructional methods or student conduct may be re- 
lated differently to frecjuency of evaluations than are rules con- 
cerning student achievement or the kee[nng of school records. 

Similarly, in 0[)erat i ona 1 i zing the availability of information 
across levels, we make no distinction between different types of 
information. Information about methods of reading instruction may, 
however, be related differently to frequency of evaluation than is 
i nfonr.^it i on oi^. ach i m t'/iit-nt :-i:ore^. 
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Interaction was. measured by reports of frequency of talking with 
others, dispensing of advice, or seeking out others in connection witli 
work, or teaming, sharing instructional materials, or otherwise taking 
other teachers into account. 

We want to emphasize that principals are evaluated on the siiigK- 
task of school administration. That task embraces many subtasks tliat 
individually could become the main preoccui>ation of either the 
evaluator or the evaluatce. There are obvious limitations, then, in 
evaluating principals on a task as global as "school administration." 
But we have no choice, since the available data refer only to tliat 
task. IVe are, however, studying tlie numerous specific hypotheses as 
individually indicating the strength of the general relation.sliips 
posited in our three basic propositions. From that standpoint, we can 
accept the inadequacies of each specific measure as we attempt to 
discern the general pattern of support or rejection of our three 
propositions . 

Source of Data 



Our data come from a survey of elementary schools in northern 
California by the Environment for Teaching Program, Stanford Centi-r 
for Research and Development in Teaching, in 1975. The principal in- 
vestigators were Elizabeth G. Cohen, Terrence E. Deal, John W. Meyer, 
and W. Richard Scott. The study involved the participation of 30 
superintendents, 103 principals, and '\69 teachers drawn from 30 dif- 
ferent school districts. The districts were drawn from urban, sub- 
urban, and rural areas and ranged in" size from a district containing 
only one school to a district with l33 schools. The number of schools 
selected for the study within each district varied according to tlie 
size of the district. One hundred and three schools were involved in 
the study, and the sul)popul at ions of superintendents, principals, and 
teachers were drawn through strati f.ed random samplin;;. 

Two types of instruments were constructed for collecting tlie 
data. There were (jues r i dniia i res i'nr occupants cf every position and 
interview schedules for the principals and superintendents. Both the 
questionnaires and the interview schedules contained structuj-ed as 
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well as open-ended questiors. Hie teacher and principal questionnaires 
were pretested before the actual survey, but the questionnaire for 
superintendents was not pretested because of the similarity of the 
questionnaires and interview schedules to those used for principals. 
There were two versions of the teacher questionnaire: one for all 
teachers and another for sixteen schools selecteu for intensive study 

The questionnaires were mailed to principals and superintendents 
before they were interviewed. The principal interviews lasted between 
forty-five minutes and one hour; the superintendent interviews lasted 
about thirty minutes. The teacher questionnaires were administered in 
groups and took about forty minutes, 

rhe data collected were scanned by us to find any possible rela- 
tionships at any level that could be used to test our three proposi- 
tions. It is our hope that such secondary analysis will counterbalance 
the deficiencies of any single hypothesis by providing a large set of 
interrelated and consistent findings, 

Arwilys i s an d Results 

Cross-tabulation is the basic jirocedure for our analysis of the 
data. Coodman and Kruskal's gamma is used as a nonparamet ric measure 
of association for contingency tables having ordinal scales (Goodman 
and Kruskal, 1DS4). Camrna measures both the direction and the magni- 
tude of association. We also performed some regression analyses to 
determine the relative strength of the three propositions as they each 
related to frequency of evaluation. This is the equivalent of partial 
correlation, 

B u r e auc r ; i tic Rules and l-requency of Hvaluation 

rabies 1 to rejn^rt the results of testing all the bureaucrati- 
zation hy])o theses. Tables A- I to A-4 in the Ajipendix report the 
results obt.'iined when certain control variables (teacher and school 
characteristics) are ex]ilicitly taken into account. At the district 
level, foi:r hypotheses were tested using reports by superintendents, 
it was predicted that the existence of explicit rules or procedures 
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TABLE 1 

Relation Between Explicit District-Wide Policies and 
Frequency of Superintendent's Evaluation of 
Principals on School Administration 



Policy Area 



Type of curricular 
materials to be used 

Instructional methods 
or techniques used 

Rules for student con- 
duct on school grounds 

Criteria for evaluating 
student learning 



Gamma ^ 

* \08 28 

-27 28 

-.67 28 

.14 28 



would be positively correlated with the frequency of the superin- 
tendent's evaluation of principals on the task of school administration. 
Two of the correlations were positive and two others were negative 
(see Table 1). We found a weak positive correlation between the fre- 
quency of the superintendent's evaluation of principals and the 
existence of explicit district-wide policies concerning type of cur- 
ricular materials and the criteria for evaluating student learning. 
But we found a negative cor-.iation between the frequency of the superin- 
tendent's evaluation of principals and the district having explicit 
policiec concerning instructional methods* and rules for student con- 
duct on school grounds. None of these relationships was statistically 
significant. 

At the school level, four hypotheses were tested using reports 
by principals. All four of the correlations were in the predicted 
positive direction (see Table 2). Thus, we found positive correla- 
tions between the frequency of the principal's evaluation of teachers 
on the task of teaching reading and the following: school procedures 
for evaluating the success of a reading program; expectation that 
principals keep systematic records on teacher evaluation; district- 
wide standard forms for teacher evaluation; and school forms for 
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TABLE 2 

Relation Between l-xplicit Procedures and 1-requency 
of Princif')al ' s Evaluation of Teachers 
on Teaching Reading 



Type of Procedure 


Gamma 


N 


School has procedures for 
evaluating the success of 
a reading program 


. 25* . 




District expects principal 
to keep systematic records 
on teacher evaluation 


. 15 


102 


Existence of district-wide 
standard forms for teacher 
evaluat ion 


.IS 


105 


Existence of school-wide 
forms for teacher 
eval uat ion 


.95 


101 



<■ .05 



teacher evaluation. The relationship in one instance is statistically- 
sii^nif Leant at the .05 level, but the four correlations are weak, 
although in the expected direction. 

At the classroom level, three hypotheses were tested using re- 
ports by teachers. All three were confirmed. We found positive cor- 
relations between the frequency of teacher's evaluation of students' 
written work in math, reading, and social studies and the presence of 
rules or guidelines governing classroom procedures. The correlations 
are moderately strong and statistically significant. The correlations 
are c strongly positive and statistically significant if the 
te.KlRT- 'xpect to adhere to a definite sequence of concepts or lessons 
m the 1:1 rructional program. Tables 5 and 4 contain these findings. 

it .s,is further predicted that the teacher's report of the princi- 
pal's and other teaclior:^' evaluation of him or her in maintaining 



TABLH 3 



Relation Between Rules Governing Classroom Procedures 
and Frequency of Teacher's Evaluation of 
Students* Written Work 



Task Evaluated Gamma N 

Math .35*** 163 

Reading .35*** 168 

Social studies .34* 191 



•p < .05 
**'*p < .001 



TABLE 4 

Relation Between Teacher* s Expectation of Adherence to a Definite 
Sequence of Concepts in the Instructional Program 
and Frequency of Teacher's Evaluation of 
Students* Written Work 



Task Evaluated Gamma N 

Math .52*** 164 

Reading .44*** 159 

Social studies .25* 192 



*p < .05 
***p < .001 
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control in the classroom would be positively correlated with the 
existence of school-wide policies governing student conduct. This 
was confirmed (sec Table 5). The correlations are weak, but the re 
lationship is statistically significant when the principal is the 
source of evaluation. 

TABLE 5 



Relation Between School -Wide Policies Governing Student 
Conduct and Teacher Reports of Frequency of 
Evaluation on Maintaining Control 



Source of Evaluation 


Gamma 


N 


Principal 


. 19* 


221 


Other teachers 


.19 


221 



*p < .OS 



In summary, the predicted relationship of bureaucratization to 
frequency of evaluation is nonexistent at the district level, posi- 
tive at the school level, and strongly positive at the classroom 
1 evel . 

' Availability of Information Acro ss 
Levels and Frequency of Hva luat i on 

It was hypothesized that availability of information about tasks 
across school levels would be positively correlated with frequency of 
evaluation. In other words, an evaluator who has readily available 
information is likely to report more frequent evaluation of performers 
on a given task; and an cvaluatee who perceives his or her evaluator 
as well-informed about task performance i:^ likely to report receiving 
more frequent evaluations. Tables 6 to 8 report the results o-P 
testing information on hypotheses 2.1 to 2.11. 
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We found weak correlations between the frequency of the sujierin- 
tendent*s evaluation of principals on school administration and 
availability (to the superintendent^ of information on criteria used 
for evaluating student learning, on student scores on other ability 
tests, and on instructional matters. On the other hand, we found no 
relation between the frequency of the superintendent's evaluation of 
principals on school administration and availability of information 
on criterion-based achievement scores. There was a negative correla- 
tion between the frequency of the superintendent *s evaluation of 
principals and information on methods of reading instruction. These 
findings are reported in Table 6. It is important to note that: the 



TABLE 6 



Relation Between Superintendent's Information about Schools 
and Frequency of Superintendent's Hvaiuation of 
Principals on School Administration 



Type of Information 



Gamma 



N 



Criteria-based 
achievement scores 



.01 



28 



Methods of reading 
instruction 



.49 



Criteria used in 
evaluating student 
learning 



.26 



28 



Student scores on 
other ability tests 



.09 



28 



Instructional matters 



.25 



28 



sample size of superintendents makes it difficult to determine whethe? 
chance processes affected these results. None of these findings was 
statistically significant. It will be recalled that two bureaucrat i- 



zation hypotheses at the district level were not confirmed; once again 
the predicted relations are nonexistent at the district level, this 
time for the information hypotheses. 

At the school level, all three hypotheses tested we/e confirmed 
(see Table 7). Thus, we found positive correlations between the 



TABLE 7 

Relation Between Principal's Information about Classrooms 
and Frequency of Principalis Evaluation of 
Teachers on Teaching Reading 



Type of Information Gamma N 



Methods of reading 

instruction .26 103 

Criteria-based achieve- 
ment scores or criteria 
for evaluating student 

learning .41* 103 

Other systematic data 
on student perfoi^mance 

as sources of information .20 103 



*p < .05 



principal's evaluation of teachers on teaching reading 'and the 
availability of information (to the principal) on methods of reading 
instruction, a statistically significant result for criteria-based 
achievement scores or criteria r evaluating student learning, and 
a positive result for the principal's use of other systematic data 
on student .rf(n'mance as sources of information. Once again, all 
the results are inoderarcly strong. The correlations remained strong 
and positive when we controlled for sex of teacher, tenure, SliS of 
students, type of classroom, and teaming (see Table A-5 of the Appendix). 
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TABl.E 8 

Relation Between Teacher^s Perception of Principal as 
Well-informed and Teacher's Report of f^requency of 
Evaluation by Principal on Teaching Subject 
Matter and Maintaining Control 



Type of Information 


Gamma 


N 


(Subject Matter) 






Instructional matters 


.44*** 


449 


Classroom instruc- 
t ional activities 


.58*** 


448 


(Maintaining Control) 






Discipline problems in 
classrooms 


.43*** 


449 



***p < .001 



We found strong positive correlations between the teacher's re- 
port of frequency of the principal's evaluation and the teacher *s 
perception of the principal as well-informed about instructional 
matters in general, discipline problems in classrooms, and classroom 
instructional activities. All three relationships are statistically 
significant at the .001 level. Table 8 contains these findings. The 
correlations remained strong and positive when we controlled for sex 
ui teacher, tenure, SES of students, type of classroom, and teaming 
(see Table A-6 of the Appendix). 

Interaction and Frequency of Evaluation 

It was hypothesized that interaction among participants in 
school organizations would be positively correlated with frequency 
of evaluation. Tables 9 to 15 report the results of testing inter- 
action hypotheses 3.1 to 3.19. 
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At the district level, we found a moderately strong correlation 
for one hypothesis and almost a zero correlation for the other. There 
were positive correlations between frequency of the superintendent's 
evaluation of principals on school administration and the superin- 
tendent's talking with principals or giving advice to them about 
management. Neither relationship was statistically significant (see 
Table 9). 

TABLE 9 

F^clation Between Principals' Reports of Interaction of 
Superintendent with Principals and Frequency of 
Superintendent's Reported Evaluation of 
Principals on School Administration 



Nature of Interaction 


Gamma 


N 


Superintendent talks 






with principals about 




28 


their work 


.03 


Superintendent gives 






advice about manage- 




28 


ment to principals 


.52 



Both hv^')Othescs tested at the school level were confirmed. We 
found a strong positive correlaLion between frequency of the princi- 
pal's evaluation of teachers on teaching reading and the frequency of 
the principal's talking with teachers about their work or advising 
them about teaching. Each of the relationships is statistically 
significant at the .001 level. Table 10 contains these findings. 

At the classroom level, all fifteen empirical h>7)ot:heses tested 
were supported. We found moderately strong correlations between 
frequency of the teacher's report of the principal's evaluation and 
frequency of the teacher's report of interaction with the principal. 
The correlations Ijctween frequency of the teacher's report of other 



ERIC 



TABLE 10 



Relation Between Interaction of Principal with Teachers 
and Frequency of Principalis Reported Evaluation 
of Teachers on Teaching Reading 

Nature of Interaction Gamma N 

Principal talks with 
teachers about their 

work .55*** lo:^ 

Principal gives advice 
about teaching to 

teachers ,57*** io5 

***p < .001 

teachers' evaluations on the tasks of teaching subject matter and 
maintaining control and frequency of individual teacher reports of 
interaction with other teachers were relatively weak but positive. We 
also found a positive correlation between frequency of the teacher's 
report of evaluation of students* written work in reading and frequency 
of the teacher's report of interaction with students. Nine of the 
relationships are statistically significant at the .01 level or 
better, while the other six relationships are not statistically sig- 
nificant but are all consistently positive as predicted by our theory. 
These results are reported in Tables 11 through 15. 

Controlling for sex of teacher, tenure, socioeconomic status (SES) 
of students, type of classroom, and teaming, we found the same general 
pattern; that is, positive correlations between interaction of the 
teacher with the principal and with other teachers and the teacher's 
report of the frequency of their evaluation, and interaction of the. 
teacher with students and the teacher's report of the frequency of 
evaluation of students' written work in reading (see Tables A-7 to 
A-12 of the Appendix). 



TABLE 11 



Relation Between Interaction of Teacher with Principal 
and Teacher's Report of Frequency of Principal's 
Evaluation of Teacher on Teaching 



Subject Matter 


Nature of Interaction 


Gamma ^ 


Teacher talks with 
principal 


oj*** 447 


Teacher seeks out 
the principal to 
talk about teacher »s 
work 


.33** 223 


Teacher reports advice 
on classroom teaching 
practices by principal 


,45*** 447 


**p < .01 
***p < .001 


TABLE 12 


Relation Between Interaction of Teacher with Principal 
and Teacher »s Report of Frequency of Principalis 
Evaluation of Teacher on Maintaining 
Control 


Nature of Interaction 


Gamma ^ 


Teacher talks with 
principal 


^30*** ^^'7 


Teacher seeks out the 
principal to talk about 
teacher ' s work 


^y*** 223 


Teacher reports advice 
on classroom teaching 
practices by principal 


.35*** ^^"^ 



***p < .001 



TABLE 13 



Relation Between Interaction among Teachers and 
Individual Teacher *s Report of Frequency 
of Other Teachers' Evaluation of Him 
or Her on Teaching Subject Matter 



Nature of Interaction 


Gamma 


N 


Teacher takes other 
classroom teachers into 
account on teaching 
approach 


.32** 


216 


Teacher takes other 
classroom teachers into 
account on lesson content 


.25 


217 


Teacher is member of 
a teaching team 


.29 




**p < .01 


TABLE 14 




Relation Between Interaction among Teachers and 
Individual Teacher's Report of Frequency 
of Other Teachers' Evaluation of Him 
or Her on Maintaining Control 




Nature of Interaction 


Gamma 


N 


Teacher takes other 
classroom teachers 
inco account on 
teaching approach 


.25 


216 


Teacher takes other 
c lassroom teachers 
into account on schedul- 
ing of class periods 


.09* 


216 


Teacher shares instruc- 
tion materials with 
other teachers 


.23 


217 


Teacher is a member 
of a teaching team 


.27 


209 



*p < .05 
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TABLE 15 




Relation Between Interaction of Teacher 
and Frequency of Teacher *s Reported 
of Students' Written Work 


with Students 
Evaluation 


i>Iature of Interaction 


Gamma 


N 


Teacher talks to 
students about their 
specific skill needs 


.54*** 


207 


Teacher talks to 
students about their 
interest in reading 


.20 


207 



***p < .001 



Results by Number of Organizational Levels 
in an Evaluation Situation 

In summarizing our findings by the number of school levels in- 
volved in an evaluation situation, it is important to note that there 
were four hierarchical positions or levels in our theoretical model. 
The forty-two hypotheses tested were distributed as follows: five 
hypotheses involved four levels, eleven involved three levels, nine- 
teen involved two levels, and seven involved one level. Three of the 
five hypotheses involving four levels were confirmed and two were not. 
Nine of the eleven hypotheses involving three levels were confirmed 
and two were not; three of the relationships were statistically signifi- 
cant and were in the predicted direction. All nineteen hypotheses in- 
volving two levels were confirmed; fourteen of the relationships. were 
statistically significant and were consistent with our theory. All 
seven hypotheses involving one level were confirmed; one of the rela- 
tionships was statistically significant and was in the expected 
direction. The distribution of. these findings indicates that the 
number of levels involved in an evaluation situation may be related 




to frequency of evaluation. It seems the fewer the levels in an 
evaluation situation, the stronger the correlation between frequency 
of evaluation and bureaucratic procedures, availability of information, 
and interaction. 

Essentially, then, we had four negative correlations out of 
forty- two examined. All four occurred when the evaluator was at the 
level of the district or superintendent, and all involved three or 
more levels. No hypothesis was unsupported when it involved two levels 
or when the evaluator was the principal, the teacher, or other teachers. 
Thus, interaction, which always involved two levels, was always sup- 
ported, even at the district level. 

Summary 



From the findings, we would conclude that availability of informa- 
tion across levels and interaction among participants are positively 
correlated with frequency of evaluation in school organizations. The 
relative weakness of the relationship to bureaucratic rules may be a 
result of bureaucratic rules serving as substitutes for direct 
evaluation. 

Having found positive correlations between frequency of evalua- 
tion and our three main variables--bureaucraJ:ic rules, information, 
and interaction--the next step was to determine the relative strength 
of these correlations when they are considered together. This led us 
to perform some regression analyses. We selected two representative^ 
variables each for bureaucratization, for information, and frr inter- 
action as predictors of frequency of revaluation. This analysis was 
possible only at the school and classroom levels, where our measures 
could be related to larger numbers of respondents. 

The six variables selected for the analysis at the school level 
were as follows. 

For bureaucratization: 

fl) The existence of district-wide forms for teacher 
evaluat Lon> 



(2) The existence of school-wide forms for teacher 
evalua / i on . 

For information: 

(3) The principal's having readily available information 
on criterion-based achievement scores. 

(4) The principal's having readily available inforiTiation 
on the methods of reading instruction used in each 
classroom. 

For interaction: 

(5) The principal's talking with teachers about their work. 

(6) The principal's advising teachers about teaching. 

Tables 16 and 17 contain the results of regressing the frequency 
of the principal's evaluation of the teaching of reading on these six 
factors. Together they account for 43 percent of the variation in the 
frequency of the principal's evaluation of teachers. The overall ac- 
curacy of this prediction equation is high, as can be seen from the 
size of the computed F-ratio, which is 12.19 (with 6 and 96 degrees 
of freedom). The probability of this result arising from chance is 
less than .001. 

To compare the representative variables in the regression equa- 
tion meaningfully, we have to use the standardized regression coef- 
ficient rather than the raw partial regression coefficient. This is 
necessary because not all six of the variables were measured on a 
uniform scale. Table 16 shows that interaction is the most powerful 
among the three categories of variables in predicting the frequency 
of the principal's evaluation of teachers. The probability value for 
this prediction is less than .001 for the two representative variables 
Information and bureaucratic rules are about the same in regression 
coefficients, and each has one statistically significant relationship 
and one nonsignificant relationship* 

At the classroom level, the teacher Wc^s treatei' not as an 
evaluator but as an evaluatce reporting the principal's evaluation of 
the teacher on teaching subject matter. As before, we selected two 
representative variables of bureaucratic rules, information, and 
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TABLE 16 



Multiple Regression of Frequency of Principal's 
Reported Evaluation of Teachers on 
Its Determinants 



Independent Variables 


Partial 
Regression 
Coefficient 


Standardized 

Regression 
Coefficient 


F 


District-wide teacher 
evaluation forms 


.02 


.00 0 


.00 


School -wide teacher 
evaluation forms 


.38 


.17 4, 


.73* 


Principal has readily 
available information 
on criteria-based 
achievement scores 


.23 


.18 4, 


.75* 


Principal has readily 
available information 
on methods of reading 
instruction for each 
classroom 


.07 


.05 0, 


.42 


Principal talks with 
teachers about their 
work 


.34 


.35 18. 




Principal advises 
teachers about 
teaching 


.24 


.31 14. 


,08*-** 



Multiple R = .43 

F-ratio = 12.19*** 



*p < .05 
***p < .001 



TABLE 17 

Matrix of Correlations of Principals' Responses 



1 2 3 4 5 6 7 

1 - .07 .27 .00 .01 .03 .05 

2 - .06 .14 .06 .03 .22 

3 - .28 .17 .10 .30 

4 - .04 .15 .19 

5 - .35 .48 

6 - .49 



7 



1 - District-wide teacher evaluation forms 

2 - School-wide teacher evaluation forms 

3 - Principal has readily available information on criteria- 

based achievement scores 

4 - Principal has readily available information on methods of 

reading instruction for each classroom 

5 - Principal talks with teachers about their work 

6 - Principal advises teachers about teaching 

7 - Principal's reported frequency of evaluating teachers on 

teaching reading 



interaction. The variables selected for the analysis at the classroom 
level were as follows. 

For bureaucratic rules: 

(1) The teacher follows the principal's suggestions concerning 
teaching methods or approach, 

(2) The teacher follows the principal's suggestions concerning 
curriculum content. 

For information: 

(3) The teacher perceiy.es the principal as well-informed about 
classroom instructional activities. 

(4^ The teacher perceives the principal as well-informed about 
instructional matters in general at any grade level. 

For interaction: 

(5) The teacht^r reports receiving the principal's advice or 
suggestions for changes in classroom teaching practices. 

(6) The teacher talks with the principal. 

Tables 18 and 19 report the results of regressing the frequency 
of each teacher's report of the principal's evaluation of him or her 
on these six factors. These factors account for 32 percent of the 
variation in the teachers' reports of the frequency with which they 
were evaluated on the task of teaching subject matter. The probability 
that this result is due to chance is less than .001. This result is 
a good indication of the overall accuracy of our prediction equation. 

In comparing the performance of the six variables in the regres- 
sion equation, information, for one variable only, seems to do better 
than interaction in this situation, but both are relatively the most 
powerful predictors. Table 18 indicates that the two bureaucratiza- 
tion variables have practically no effect on the frequency of the 
teacher '3 report of the principal's evaluation of the teacher on 
teaching subject matter. In both cases, the partial as well as the 
standardized regression coefficient is almost zero. It is also clear 
from Tables 17 and 19, that information variables are positively 
correlated with interaction variables. The correlations are generally 
much stronger than the correlations of bureaucratization variables 
with other variables, as can be seen from the correlation matrices. 
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TABLE 18 



Multiple Regression of Frequency of Teacher *s Report 
of Principal's Evaluation of Teacher on 
Its Determinants 



Independent Variables 


Partial 
Regression 
Coefficient 


Standardized 
Regression 
Coefficient 


• 


F 


Teacher follows principal's, 
suggestions concerning 
teaching methods 


.01 


.01 


0. 


05 


Teacher follows principalis 
suggestions concerning 
curriculum content 


.02 


.01 


0. 


.09 


Teacher perceives principal 
as well-informed about 
classroom instructional 
activities 


.50 


.38 


43, 


gy * * * 


Teacher perceives principal 
as well-informed about 
instructional matters at 
any grade level 


.07 


.05 


0 


.83 


Teacher reports receiving 
principal's advice on 
classroom teaching 
practices 


.33 


.22 


27 


.47*** 


Teacher talks with 
principal 


.07 


.06 


2 


.45 



Multiple = .32 

F ratio = 33.32*** 



***p < .001 



TAB'.E 19 

Matrix of Correlations of Teachers' R'espons 



.69 .29 .29 .11 .02 

•24 ,28 .06 .02 

.69 .30 .27 

.30 .22 
.25 



Teacher follows principal's sugRcstions concerning teaching 

Teacher follows principal's suggestions concerning curriculum 
content 

Teacher perceives principal as well-informed about classrocr- 
instructional activities 

Teacher perceives principal as well-informed about instruc- 
tional matters 

Teacher reports receiving principal's advice on cla.<;sroom 
teaching practices 

Teacher talks with principal 

Teacher reports of frequency of principal's evaluation of 
teacher on teaching subject matter 
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Conclusion 



By doing some regression analyses, we found that interaction is 
f.e most powerful predictor of frequency of the principal's report of 
evaluation of teachers on teaching reading. Bureaucratic rules arc the 
least powerful compared to interaction and information. At the class- 
room level, both information and interaction are powerful predictors 
ct frequency of the teacher's report of the principal's evaluation of 
the teacher on teaching subject matter, and bureaucratization had no 
separate effects on the frequency of evaluation. 

These findings suggest that it is theoretically as well as 
c-npirically fruitful to adopt a processual approach to the study of 
interlevel linkages in school organizations. We can conclude that 
availability of information across levels and interaction among par- 
ticipants are positively correlated with frequency of evaluation in 
school organizations. The correlation between bureaucratic rules and 
frequency of evaluation, on the other hand, was found to be generally 
weak. The failure of bureaucratization variables requires a closer 
examination since bureaucratic rules correlate strongly with frequency 
of evaluation in some situations but not in others. Another instance 
that is worth mentioning in this connection is the performance of the 
two representative bureaucratization variables in our prediction 
equation. While the partial regression coefficient for the existence 
of district-wide evaluation forms for teacher evaluation is almost zero 
(.02), it is .38 when a school has its own evaluation forms. Although 
both bureaucratic procedures are concerned directly with teacher 
evaluation, the two results are significantly different. A possible 
explanation is that d ist rict -wi dc evaluation forms for teacher evalua- 
tion do not carry the same amount of pressure potential to activate 
the principal as an evaluator. A situation such as this could also 
be interpreted as an instance of loose coupling in scliool organizations 

It is al.so worth noting tha^ the type of information involved in 
an ev.luaH.r, situation m-.kes a difference. Two of the representative 
information variables in the regression equation at the school level 
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demonstrate this. If the principal has information on criteria-based 
achievement scores, the partial regression coefficient is .25; however, 
it is only .07 if the principal has information on methods of reading ' 
instruction. Also, it makes a difference if a teacher perceives the 
principal as well-informed about instructional matters. The first 
instance is likely to generate more pressure on the teacher as an 
evaluatee than the second. The partial regression coefficients for 
these two types of information in Table 18 point to this underlying 
difference. 

One theoretically relevant issue deserves some attention. In 
analyzing our data, we controlled for ty^e of classroom at the school 
as well as at the classroom level. A common pattern seems to emerge. 
Principals and teachers in schools with open-space classrooms tend to 
respond similarly to the existence of bureaucratic rules in the per- 
formance- of their control task. There is consistently a stronger 
correlation between frequency of evaluation and bureaucratic rules 
among this category of evaluators than among principals and teachers 
in schools with self-contained classrooms. These findings are reported 
in Tables A-1 to A-4 in the Appendix. 

Another point of theoretical interest is the idea of school 
organizations as loosely coupled systems. A close examination of some 
of the characteristics listed in the literature would indicate that 
frequency of evaluation could be incorporated in our definition of 
loose coupling, [-roquency of evaluation, according to our findings ! 
correlates with two important organizational processes: information 
and interaction. Information flow across levels and interaction among 
participants seem' to cohere, and frequency of evojuation is a possible 
indicator of their presence. This assertion i. supported by the fact 
that six representative variables of bureaucratic rules, information, 
and interaction determine approximately 43 percent of the variation in 
frequency of the principal's oualuation of teachers on teaching reading 
and 32 percent of the variation in frequency of the teacher 's repovr 
of .he principal's evala-.tion of the teacher oi teaching suhject: 
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Infrequent evaluation could therefore be used as one of the 
defining properties of loosely coupled systems. We suggest that 
school organizations are loosely coupled because evaluation is less 
frequent. This, of course, raises the question of the frequency of 
evaluation in organizations that are tightly coupled. We would need 
to study some tightly coupled organizations, using our findings as a 
benchmark for comparisons. Only then will we be able to assess the 
degree to which school organizations are loosely coupled in terms of 
frequency of evaluation across levels. 

Impl ications 

One problem about evaluation in school organizations is that it 
is infrequent across levels. Teachers, for example, seem more satis- 
fied when evaluation of their performance is less infrequent, regard- 
loss of whether the evaluations are positive or negative. As Thompson 
and others have observed, "teacher evaluations currently received in 
the public schools are so infrequent that teachers are . . . almost 
eager for increased attention" (Thompson, Dornbusch, and Scott, 1975, 
p. 14). The problem is the relative lack of frequent evaluations. 
The question is how to increase the frequency of evaluations in school 
organizations. Obviously, we could not increase the frequency of 
evaluations in school organizations without first being able to identify 
some of the factors associated with it. We consider our research 
findings useful from this standpoint. 

One way of ■ increasing frequency of evaluations in school organi- 
zations is to create structures for the maximi 7.at ion of information 
and interaction opportunities across levels and among participants. 
The sequence of any such strategic intervention would probably require 
some further field experimentation, because we have not identified 
all the factors associated with frequency of evaluation, nor have we 
determined the direction of causation. 
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TABLE A-1 

Relation Between Explicit Procedures and Frequency of Principal's 
Evaluation of Teachers on Teaching Reading, Controlling 
for Sex, Tenure, SES of School, School Si7.e, 
and Type of Classroom 
(Expressed in Gammas) 





Sex 


Tenure 


School 
SES 


Size 


CI ass room 
Type 


Type of 
Procedure 


Male Female 
(N=80) (N=:22) 


Short Long 
(N=S4) (N=42) 


Low High 
(N=8fD) (N=1S) 


Smal 1 Large 
(N=46) (N=56) 


Self- 
Open contained 
(N=4 7j (N=54) 


School has pro- 
cedures for 
evaluating the 
success of a 

gram 


.27** .23 


.46** .19 


.25 .04 


.37** .16 


.48* .07 " 


District ex- 
pects princi- 
pal to keep 
records con- 
taining 
systemat ic 
information 
on teacher 
evaluat ion 


.01 .89 


-.22 .00 


.08 .60 


.16 .14 


.2i:' .03 


District has 
standard 
forms for 
teacher 
evaluation 


.16 


.60 


.21 


-.94 .64 


.3.S -.32 


School has 
form5 for 
teacher 
evaluat ion 


.44** .07 


. 34 . 34 


.33 .25 


.23 .42 


.46 .21 



Chi-square significance level; *.05 **.01 
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TABLE A-2 

Relation Between Rules Governing Classroom Procedures 
and Frequency of Teacher's Evaluation of Students' 
Written Work, Controlling for Sex, Tenure, 
SES of Students, Type of Classroom, 
and Teaming 







(Expressed 


in Gammas) 








Sex 


Tenure 


Student 
SES 


Classroom 
Type 


Teaming 


Task 

Evaluated 


Male Female 
(N=23) (N=136) 


Yes No 
(N=143) CN=18) 


Low High 
(N=93) CN=67) 


Self- 
Open contained 
CN=34'J CN=128) 


Non- 
Member Member 
CN=79} (N=68) 


Math 


-.03** .44 


.43*** -. 14 


.35 .36*** 


.66 . IS*** 


.16 .45 


Reading 


.06 .44 


.3i)*** .23 


.34 .33*** 


.55 ,27*** 


.29 .31 


Social 
studi es 


.38* .35* 


.30 .75 


.32 .42 


.48 .30 


.36* .25 


Chi -square 


significance level: *.05 **. 


01 ***.001 
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TABLE A- 3 

Relation Between Teacher^s Expectation of Adherence to a Definite 
Sequence of Concepts in Instructional Program and F-requency of 
Tercher's Evaluation of Students* Written Work, Controlling 
for Sex, Tenure, SES of Students, Type of Classroom, 

and Teaming 
(Expressed in Gammas) 





Sex 


Tenure 


Student 
SES 


Classrooni 
Type 


Teaming 


Task 

Evaluated 


Male Female 
(N=2 5) (N=137) 


Yes No 
(N=i44) (N=:1S) 


Low High 
(N=94) (N=67) 


Self- 
Open contained 
(N=54) (N=129) 


Non- 
Member Member 
(N=82) (N=(>9j 


Math 


.37*** .51 


.30*** .57 


.58 .49** 


.48 .52*** 


.49 .46 


Reading 


.72 ,35*** 


.44*** .44 


.52** .59* 


.78 .31*^* 


.49*** .29 


Social 
studies 


.44** .21 


.23 .14 


.29 .25* 


.47 .18 


.31 .12 



Chi -square significance level: *.05 



* * Q J * * * 



,001 



ERIC 



50 



-44- 



TABLE A-4 

Relation Between School-Wide Policies Governing Student Conduct 
and Teacher Reports of Frequency of Eval»:ation on 
Maintaining Control, Controlling fov Sex, 
Tenure, SES of Students, Type 
of Classroom, and Teaming 
(Expressed in Gammas) 





Sex 


Tenure 


Student 
SES 


Claj;sroom 
Type 


Teaming 


Source of 
Evaluat ion 


Male Female 
(N=52) CN=181) 


Yes No 
(Nr-196) (N=20) 


Low High 
(N=127) (N=84) 


Self- 
Open contained 
(N=46"> (N=170) 


Non- 
Member Member 
(N=115) (N=86) 


Princ ipal 


.14 .20 


.18* .42 


.21* .08 


.22 . 21 * 


.24* .11 


Other 
teachers 


.20 ,2''i 


.24 -.13 




..SJ .17 


.26 .10 



Chi-square significance level: *.05 
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TABLI; A- 5 

Relation Between Principal's Information about Classroons and 
Frequency of Principal's Evaluation of Teachers on 
Teaching Reading, Controlling for Sex, Tenure, 
SBS of School, School Size, and 
T/pe of Classroom 
(Expressed in Gammas) 





Sex 


Tenure 

1 


School 
SES 


Size 


Classroom 
Type 


Type of 
Info rmat ion 


Male Female 
(N=81 ) (N=221 


Short Long 
(N=S41 CN=45) 


Low High 


Small Large 
fN=46 ) rN=S71 


Sol f- 
Qpen contained 


Reading 
methods 
used in 
each class- 
room 


.51 -.02 


.25 .2h 


.52 -.14 


.20 .29 


.:(> .08 


Cr j ter ia~ 
based 

achievement 
scores or 
criteria for 
evaluat ing 
student 
learning 


.45* -.05 


.47* .42 


.57** .75 


.52 .55* 


-.02 


Other 
systemat ic 
data on 
student 
perfo rmance 


.50 -.50** 


.55 .20 


.20 -.07 


.12 .25 


. 52 . 1 1 



Chi-square significance level: * . 05 **.0l 
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TABLH A-6 

Relation Between Teacher's Perception of Principal as Well-informed 
and Teacher *s Report of Frequency of Principalis Evaluation 
on Teaching Subject Matter and Maintaining Control, 
Controlling for Sex, Tenure, SES of Students, 
Type of Classroom, and Teaming 
(Expressed in Gammas) 





Sex 


Tenure 


Student 
SES 


Classroom 
Type 


Teaming 


Typo of 
Informat ion 


Male Vemale 
(N=70) (N=373) 


Yes No 
(N=40S) (N=36) 


Low High 
(N=272) (N=159) 


Self- 
Open contained 
(N=117) (N=330) 


Non- 
Member Member 
(N=257) (N=157) 


(Subject 
Matter) 












Instruct Lonal 
matters 


.SO .43*** 


.44*'-* .47 


. 58*** .52*** 


.51^** .40*** 


^9*** 41**'' 


Classroom in- 
structional 
act ivit les 




.59** . 59 


* * * 66*** 


^g*** 52*** 


^0*** 58*** 


(Maintaining 
Cont rol ) 












Di sc ipl ine 
prob lems 
in class- 
rooms 


.33 .46*** 


.-16*** .29 


.32* .59*** 


4y*** 4"?*** 


.45*** .46--** 



Chi-square significance level: * . 05 *'',01 ***.001 
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TABLE A- 7 

Relation Between Interaction of Principal with Teachers and 
Principalis Report of Frequency of Evaluation of Teachers 
on Teaching Reading, Controlling for Sex, Tenure in 
School, SES of School, School Size, and 
Type of Classroom 
(Expressed in Gammas) 





Sex 


1 

Tenure 


Schoo 1 
SES 


Size 


Classroom 
Type 


Nature of 
Interact ion 


Male Female 
(N=81)(N=22) 


Short Long 
(N=54) (N=43) 


Low High 
(N=88) (N=15) 


Small Large 
(N=46) (N=57) 


Self- 
Open contained 
(N=47) (N=:S6) 


Principal 
talks with 
teachers 
.^bout their 
work 


.51** .70** 


.54* .48 


.58*** .54 


.62*** .49 


.46 .67*** 


Principal 

gives 

teachers 

advice or 

info rmat ion 

about 

teaching 


.43 .87* 


.41 .70*** 


.62*^^* .15 


.66*** .48 


.46 .67*** 



Chi-square significance )evel: *.05 **.01 ***.001 
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TABLE A- 8 

Relation Between Interaction of* Teacher with Principal and 
Teacher's Report of Frequency of Principalis Evaluation 
of Teacher on'Teaching Subject Matter, Controlling 
for Sex, Tenure, SES of Students, Type of 
Classroom, and Teaming 
(Expressed in Gammas) 





Sex 


Tenuve 


Student 
SES 


Classroom 
Type 


Teaming 


Nature of 
Interaction 


Male Female 
(N=56) (N=186) 


Yes No 
(N=204) (N=17) 


Low High 
(.M=144)(N=73) 


V Self- 
Open contained 
(N=70) (N=152) 


Non ' 
Member Member 
(N=138) (N=70) 


Teacher talks 
with principal 


.29 .28*** 


.26*** .31 


.21* .37 


.05* .37*** 


.25* .56* 


I ?avher seeks 
o:it principal 
alk about 
teaciter*s work 


.18 .56** 


.54** .01 


.35* .26 


.50 .35* 


.50** .51 


Teacher 
rep-j ts 
advice on 
class i in 
teach . :.f^, 
pra.r ices 
from 

principal 


.45* .45*** 


.45*** .45 


^47*** .42* 




.43*** .46** 



Chi-square significance levels: "^'.05 **.01 ***.001 
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TABLl: A-9 

Relation Between Interaction of Teacher with Principal and 
Teacher's Report of Frequency of Principal's Evaluation 
of Teacher on Maintaining Control, Controlling for 
Sex, Tenure, SES of Students, 'I'/pe of 
Classroorr, and Teaming 
(Expressed in Gam^uas) 







1 










Sex 


1 

Tenure 


Student 
SES 


Classroom 
T>npe 


i earning 










Sel f-con- 




Non- 


Nature of 


Male Female 


Yes No 


Low High 


Open tained 


Member Member 


Interaction 


CN=36) (N=lSb) 


CN=204) CN=17) 


(N=144) CN=73) 


CN=70)(N=152) 


(N=158) (N=70) 


Teacher 












talks with 












principal 


.50 .50** 


.28** .54 


.24 .42-^* 


.20 .53*** 


^ 9 * A * - J 


Teacher 












seeks out 












principal 
to talk 












about 












teacher' s 












work 


.24 .41** 


.36** .32 


.42** .23 


.57 .56* 


.34** .36 


Teacher 












reports 
advice on 












c 1 as STOom 












teaching 












pract ices 
from 












principal 


,39 .35*'^* 


.37*** .10 


.33**^ .33*** 


•^y ^ * * 2^ * * * 


.25'^ .46*^^^ 



Chi-square significance level: ''.O.S **.ni ***.O01 
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TABLE A- 10 

Relation Between Interaction among Teachers and Teacher's Report 
of l-requency of Other Teachers' Evaluation of Teacher 
on Teaching Subject Matter, Coatrolling for 
Sex, Tenui'e, SES of Students, Type of 
Classroom, and Teaming 
(Expressed in Gammas) 





Sex 


Tenure 


Student 
SES 


Classroom 




Nature of 
Interact ion 


Male Female 
(N=33) (N=173) 


Yes No 
(N=18'^) (N=18) 


Low High 
(N=115) (N=85J 


Self-con- 
open tained 
(N=46) CN=162) 


Non 

Member Member 
(N=114) (N=87) 


Teacher takes 
other class- 
room teachers 
into account 
on teaching 
approach 


.44 .19* 


.51* .41 

• ••»« 


.26* .39 


.55 .23 


.34 .21 


Teacher takes 
other class- 
room teachers 
into account 
on lesson 
content 


.23 .24 


.24 .28 


.25 .29* 


.54 .17 


.55** .08 


Teacher is 
member of a 
teaching 
team 


.55 .24 


.28 .40 


.45* .10 


.27* 





Chi-j;quarc significance level: *.()5 **.01 
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TABLH A- 11 

Relation Between Interaction among Teachers and Teacher's Report 
of Frequency of Other Teachers' Evaluation of Teacher 
on Maintaining Control, Controlling for Sex, 
Tenure, SES of Students, Type of 
Classroom, and Teaming 
(Expressed in Gammas) 





Sex 


Tenure 


Student 
SES 


Classroom 
Type 


Teaming 


Nature of 
Interaction 


Mai e Female 
(N=32}(N=175) 


Yes No 
(N=1S7) (N=18) 


Low High 
(N=115) (N=85) 


Sel f-con- 
Open tained 
(N=46] (N=162) 


Noil- 
Member Member 
(N=114) (N=87) 


leacner LaNcb 
other class- 
room teachers 
into account 
on teaching 
approach 


.11 .25 


.22 .55 


.20 .52 


.52 .15 


.26 .17 


Teacher takes 
other class- 
room teachers 
into account 
on schedul- 
ing of class 
periods 


.22 .06 


.08* .14 


.06 .17 


.45 .00 


.07**' .03 


Teacher shares 
instruct ional 
materials 
with other 
teachers 


.18 .21 


.26 -.04 


.24 .25 


.50 .21 


.11 .24 


Teacher is 
member of a 
teaching 
team 


.25 .26 


.27 .40 


.57 .12 


.25 





Chi-square significance level: ^".05 **.01 
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TABLE A- 12 

Relation Between Interaction of Teacher with Students and 
Teacher's Report of Frequency of Evaluation of 
Students' Written Work in Reading, 
Controlling for Sex, Tenure, 
SES of Students, Type of 
Classroom, and Teaming 
(Expressed in Gammas) 







Tenure 


Student 
SRS 


C] assroom 
Type 


Teaming 


Nature of 
Interact ion 


Male Female 
(N=26) (N=i77) 


Yes No 
(N=1S6) (N=19) 


Low High 
(N=96) (N=66) 


Sel f-con- 
Open tained 
(N=33) (N=135) 


Non 

Member Member 
(N=81) (N=71) 


Teacher talks 
to students 
about their 
spec i f ic 
skill needs 


.'10 .54** 


.51** .70 


.47 .48 


.56 .49 


.56^ .52 


leacher talks 
to students 
about their 
interest in 
read ing 


-.03 .23 


.18 .35 


.05 .14 


-.OS .16 


.02 .29 



Chi -square significance level: *.C)5 **.01 
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